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METHOD FOR GENERATING AND DETECTING MARKS 

Technical Field of the Invention 

The present invention relates to the generation, embedding and detection of 
patterns in images, audio streams, video, and documents or surfaces of articles. Such 
embedded patterns may be used for invisible watermarking, and/or for alignment 
5 information. In particular, the present invention relates to embedded patterns that have 
scale and rotation invariant properties. 

Background Art 

With the advent of digital images and digital image distribution, protection of such 
10 digital images against unauthorised copying has become an issue for image publishers and 
authors. One technique used to identify the ownership of an image is to embed a pattern 
or patterns into the image, such that the embedded pattern is not visible to the naked eye 
of an observer. Such a pattern is called a watermark. The presence of the watermark can 
be detected in the copied image by the owner of the original image, thereby proving their 
15 ownership. 

Systems are known for embedding a pattern or patterns into an image or 
document. However, present methods of invisible watermarking of documents and 
images are often very sensitive, therefore not robust, to geometric image distortions. The 
most common image distortions are changes in the magnification or scaling, changes to 
20 the orientation of the image or rotation, and losing edge information of the image or 
cropping. 
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Known methods which are robust to such changes, are either incapable of storing 
significant amounts of data in the watermark, or are susceptible to malicious intervention 
for the reason that the pattern is easily detected by simple spectral methods. One such 
spectral method is an analysis of the Fourier magnitude peaks of the image with an 
5 embedded watermark. 

One of the most popular and effective methods for detecting patterns is 
correlation. In fact, for linear systems, correlation, or matched filtering, can be shown to 
be mathematically, an optimal detection method. Unfortunately correlation in two 
dimensions is not, in general, invariant with orientation or scaling. 

10 It should be noted that correlation can only give well defined and easily 

distinguished correlation magnitude peaks if the underlying pattern has a broad Fourier 
magnitude distribution. This is a consequence of the uncertainty principle. Therefore, 
patterns with very sharp or constrained Fourier magnitudes, such as a narrow-bandpass 
function, are ill equipped for correlation purposes. 

15 Rotation invariance in known systems is typically achieved by using circular 

symmetric patterns. Alternatively the correlation can be repeated many times with the test 
pattern at many different orientations, so that at least one correlation is close to the actual 
orientation. Scale related problems are usually solved by repeated correlations at many 
different scales so that at least one correlation is close to the actual scale. Such methods 

20 are impractical, and as a consequence, correlation seldom is used in cases when arbitrary 
rotation and/or scaling is present. 
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v Disclosure of the Invention 

It is an object of the present invention to substantially overcome, or at least 
ameliorate, one or more disadvantages of existing arrangements. 

According to a first aspect of the invention, there is provided a method of 
5 watermarking an image, said method comprising the step of: 

mathematically adding at least one basis pattern to said image, wherein said basis 
pattern(s) is scale and rotation invariant within a complex multiplicative constant. 

According to a second aspect of the invention, there is provided a method of 
detecting a pattern in a watermark of an image, said watermark comprising at least one 
1 0 basis pattern, with said pattern and said basis pattem(s) being scale and rotation invariant 
within a complex multiplicative constant, said method comprising the steps of: 

correlating said image with said pattern; and 

locating one or more magnitude peaks, said peak(s) corresponding to center 
position(s) of basis pattem(s) having the same parameters as that of said pattern. 
1 5 According to a third aspect of the invention, there is provided a method of adding 

registration marks to an image, said method comprising the step of: 

mathematically adding a plurality of basis patterns to said image, wherein at least 
two of said basis patterns are added with different offsets relative to a center of said 
image, and said basis patterns are scale and rotation invariant within a complex 
20 multiplicative constant. 

According to a fourth aspect of the invention, there is provided a method of 
registering an image having a watermark embedded, said watermark comprising a 
plurality of basis patterns, said method comprising the steps of: 
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correlating said image with a pattern; said pattern and said basis patterns being 
scale and rotation invariant within a complex multiplicative constant; 

locating peak positions, said peak positions corresponding to center positions of 
basis patterns having the same parameters as that of said pattern; 
5 comparing said peak positions with predetermined positions from an original 

image; and 

transforming said image to invert linear transformations. 

According to a fifth aspect of the invention, there is provided a method of 
watermarking an audio stream, said method comprising the step of: 
10 mathematically adding at least one basis signal to said audio stream, wherein said 

basis signal(s) is scale invariant within a complex multiplicative constant. 

According to a sixth aspect of the invention, there is provided a method of 
detecting a signal in a watermark of an audio stream, said watermark comprising at least 
one basis signal, with said signal and said basis signal(s) being scale invariant within a 
15 complex multiplicative constant, said method comprising the steps of: 
correlating said audio stream with said signal; and 

locating one or more magnitude peaks, said peak(s) corresponding to center 
position(s) of basis signal(s) having the same parameter as that of said signal. 

According to another aspect of the invention, there is provided an apparatus for 
20 implementing any one of the aforementioned methods. 

According to another aspect of the invention there is provided a computer program 
product including a computer readable medium having recorded thereon a computer 
program for implementing any one of the methods described above. 
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Brief Description of the Drawings 

A number of embodiments of the present invention will now be described with 
reference to the drawings, in which: 

Fig. 1 shows a section of a scale invariant function; 

Figs. 2A and 2B show the real and imaginary parts of a logarithmic radial phase 
function having an annular region defined by minimum and maximum radii; 

Figs. 3A and 3B show the real and imaginary parts of a logarithmic radial 
harmonic phase function; 

Fig. 4 shows a schematic diagram of a process of watermarking an image; 

Fig. 5 shows an example watermark pattern; 

Fig. 6 shows an example image with the watermark pattern of Fig. 5 embedded 
using the process of Fig. 4; 

Fig. 7A shows a schematic diagram of an alternative process of watermarking an 
image using de-emphasis; 

Fig. 7B shows the example image with the watermark pattern of Fig. 5 embedded 
using the process of Fig. 7 A; 

Fig. 8 shows a schematic diagram of a process of detecting a watermark in an 

image; 

Fig. 9 shows a schematic diagram of an alternative process of detecting a 
watermark in an image using emphasis; 

Fig. 10A shows the magnitude image of correlating the image of Fig. 6 with the 
correct pattern using the detection process of Fig. 8; 

Fig. 10B shows details of one of the magnitude peaks of Fig. 10A; 
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Fig. 11A shows the magnitude image of correlating the image of Fig. 7B with the 
correct pattern using the detection process of Fig. 9; 

Fig. 1 IB shows details of one of the magnitude peaks of Fig. 1 1 A; 

Fig. 12 shows the example image of Fig. 6 rotated, scaled and cropped; 
5 Fig. 13 shows the result of correlating the image of Fig. 12 with the correct pattern 

using the detection process of Fig. 9; 

Fig. 14 shows details of one of the magnitude peaks of Fig. 13; and 

Fig. 15 shows a schematic block diagram of a system. 



1 0 Detailed Description 

Basic properties of a group of functions, including their correlation properties, will 

first be described. Processes for watermarking, watermark detection, and apparatus 
follows the description of the basic properties of those functions. 

Certain functions have a scale invariant property, whereby a change of scale in the 
15 coordinate results in a transformed function that is the same as the original function, apart 
from a multiplicative constant. These functions are sometimes referred to as 
homogeneous functions. Consider a homogeneous function: 

/(r) = cos[tfln(r)] (1) 
having a logarithmic phase as follows: 

20 y/(r) = aln(r) (2) 

Such a phase has a frequency of = — . The function f(r) has the useful scaling 

dr r 

property, in that: 
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/ [ar ) = cos [a In (ar )] = cos [a In (r ) + a In (a )] (3) 
In other words, a coordinate scale change only produces a fixed phase change in 
the cosine, providing the scale invariant property. The function in Equation (1) has some 
peculiar properties, such as an infinite number of periods in the range 0 < r < e , and the 
5 phase approaches as the radius tends to zero. The undesired effects of these 
properties can be largely avoided by removal of a central region below a threshold radius. 
Fig. 1 shows a one-dimensional example of a simple oscillating homogeneous function 
having the form of Equation (1), for values 0.01 < x < 1 . 

The homogeneity condition can also be viewed as a self-similarity criterion. Self- 
10 similar functions produce correlation magnitude peaks even when one of the correlated 
functions is rescaled. A complex function with the self-similarity property is: 

/ a (r) = r'exp[toln(r)] (4) 
A scale change provides: 

f a (ar) = a p r p exp[/aln(r)]exp[toln(a)] = a p exp[/aln(a)]/ a (r) (5) 
15 which introduces a magnitude and phase change. By using a complex exponent: 

exp[taln(r)] = r te (6) 
Equation (4) can be written as: 

f a (r) = r p+ia (7) 
Equation (7) represents a family of functions, which have a periodic radial 
20 structure. Figs. 2A and 2B show the real and imaginary parts of a pattern having the form 
of Equation (7) where a polar distance r is defined in terms of the Cartesian axes as 
^= x 2 + y 2 and in which values of r < R x has been removed to avoid aliasing. The complex 
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fiinction fdr) has negative values. Therefore, for the function fj/) to be displayed, the 
values the function /«(/*) have been normalised around a value of 127, with all values 
ranging from 0 to 255, with 0 representing black, 255 representing white, and 
intermediate levels representing levels of grey. 
5 Functions of the form of Equation (7) have some useful orthogonality properties 

over an annular region, with the annular region defined by a maximum radius R2 and the 
minimum radius R\ . Consider the radial function: 

f m (r) = r"r^ (8) 
The correlation at the origin, or zero shift, is defined by an overlap integral I m „ of 
10 this function f m (r) with another similar function f„(r) with parameter a n instead of 
parameter cc m , and can be written in polar coordinates as: 

I- =\^rf m{ r)f'M d r= * 2 , + 2 + <(a , ^ 1 <*> 

From Equation (9), it can be seen that a prerequisite of orthogonality of the 
functions f m (r) and^(r), is that p = -1 . For one-dimensional functions, the orthogonality 

1 5 prerequisite is p = - 1/2 . 

Generally, the magnitude squared of the overlap integral I I mn \ 2 may be written as 
a sine function as follows: 



(^sin^iK-aJln^/J?,] 



The magnitude of the overlap integral I I mn \ is a maximum as the parameters a n 
20 and a m approach a n - a m = 0 , and zero when 
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cc m -a = — r^7-^r, 7 = integer , but y * 0 (11) 
m n \n[R 2 /R x ] 

In practice, the magnitude of the overlap integral I /„„ I is small or negligible when 
2k 



(12) 



ln[^/^] 

The above condition is an approximate orthogonality condition, useful for 
5 estimation purposes. In practice the ratio R 2 /R x is chosen to be of the order 2 to 4, so that 
ln(i? 2 //?,)« 1. 

By including a spiral phase function in Equation (8), thereby causing polar angle 



6> = tan" 



y/ 

/ X 



variations in the pattern function, it can be shown that the pattern function 



retains its scale invariant and orthogonality properties. Consider a scale and rotation 
10 invariant pattern g, which has a circular harmonic phase defined by the parameter k, where 
parameter A: is an integer. Such a function is sometimes referred to as a logarithmic radial 
harmonic function [LRHF], and has the form: 

g mk {r,e) = r p r ia »e ikd (13) 
The overlap integral I mkn i of this LRHF g m ^r t 0) with another similar LRHF g n i(r t 9) 
15 with parameters a n and k, over an annular region, is: 

'--nC 2,n »-^ i ( r > ws - 2 *n« ,H, ' , '<' w ^* <i4) 

As is evident from Equation (14), the overlap integral I mkn i is simple to calculate 
because of the radial/tangential separability. Equation (14) can be further simplified 
because the tangential component integrates to a Kronecker delta function as follows: 
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% (15) 

causing the overlap integral I m kni to simplify to 

( R^ +2 R} a -- a " ] - R^R^--^ ) 

Lkn<=(2< ) 7 n " ( 16 ) 

-*"' K J u 2p + 2 + i{a m -cc n ) 

Again, at orthogonality where p=-l, the magnitude squared of the overlap integral 



is: 



2 (|K-« n M*2/*,]) 



sin 

I W = (4xf ^- -5 L (17) 

The preceding analysis refers to complex exponential functions, but in practice, 
images are limited to real, as well as positive, reflectivity, transmissivity, or intensity 
values. It can be shown that if the overlap integral I m kni is calculated for the real part of 
10 one LRHF g mk with a full complex LRHF g n u a magnitude squared of the overlap integral 
Um*«/I 2 would be obtained that is similar to Equation (17), but reduced by a factor of 
four. 

Therefore, the LRHF g m k is defined by the real value m and integer parameter 
where real value m defines in the parameter a m as: 

15 a m = ^ m . (18) 

In a typical application the LRHF g m k is evaluated over a discrete image with a 
finite size, and where the pixel positions (x,y) only contain discrete integer values. To 
avoid aliasing, constraints are imposed on the allowable values for the parameters k and 
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10 



15 



The LRHF g m k has a well defined local frequency q(xy), which is defined as the 
modulus of the gradient of the phase of the LRHF g mk (r) , so 



f w -0 


2 




I dx ) 







(19) 



where 

gmk =t m *|exp(/ v F mA ) 

Hence, from Equation (13), the phase is 



^ mk =a m \nr + kO 



(20) 



mk m 



a m dr dO xa m — ky 



+ k— = 
dx r dx dx 



(21) 
(22) 

(23) 



dy r dx dx 

Substituting Equations (22) and (23) into Equation (19), local frequency q(x,y) is: 



v(x>y) = 



(24) 



In other words, the radial and tangential frequencies are square additives. In fact 
the full 2D frequency is just the vector sum of the radial and tangential frequency vectors. 
It is also noted that the orientation of the local frequency qix^y) is always fixed relative to 
the polar angle 0 : 



tan 



dy / dx J \_xa m - 



dy 
where 



kx 



= tan[^ + ^] 



(25) 
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tm[z] = — ,tan[0] = ^ 

a„ x 



(26) 



This property means that spirals in the LRHF g mk are equi-angular. 
The minimum frequency q min for an annular LRHF g mk occurs at the maximum 
radius R2 and the maximum frequency q max at the minimum radius R\ defined respectively 
5 by: 



The maximum frequency q max is kept below the Nyquist frequency of the discrete 
image. Figs. 3 A and 3B show the real and imaginary parts respectively of a typical LRHF 
g m k with parameters £=50 and a m =50. 



most interest in this implementation is their correlation property. Correlation at the origin 
has been dealt with in the overlap integral I mk i n . 

In the more general case of cross-correlation and auto-correlation, a 2D-correlation 
function is obtained. An efficient method of correlating two large image functions is via 

1 5 the Fast Fourier Transform (TFT). 

It is convenient to work with continuous Fourier Transforms initially, although 
much of the mathematics transfers directly to the discrete case with discrete Fourier 
transforms, with the exception of infinite frequency parts. Consider first the case of 
purely radial functions with complex exponent c, having the form of Equation (8), and its 

20 transform: 




(27) 



10 



The foregoing described the basic properties of LRHFs. However, the property of 



■c r(l-c/2) 
T(c/2) 



(28) 
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Here T( ) is the generalised factorial (gamma) function. Using partial derivatives 
it can be shown that LRHFs g mk having the form of Equation (13), have the following 
transform pair: 

r'r te -e" <=> ^q'^q'^e^ (29) 
5 The parameter \x is a complex constant related to the gamma function T( ). It is 

noted that no coordinate scaling is necessary to estimate the form of the Fourier transform. 
In fact the Fourier phase § is essentially the same as the spatial phase 0, except for a sign 
reversal in the radial component. This can be seen from the following: 

arg [r p r ia e ine ] = a In [r] + nO (30) 

10 arg[M mkp q- p - 2 q- ia "e ik *] = const ~a m ln[ 9 ] + *0 (31) 

One of the principle applications of correlation in image processing is in the area 
of template matching. Correlation is therefore used to detect the presence of a pattern, 
such as a LRHF g mk , in an image f 9 where the image f{x,y)==p(x,y)+g n i(x,y). Correlation 
between pattern g m k and image / produces a 2 dimensional image with maximum values at 

15 positions where the image/best matches the pattern g mk . The Fourier correlation theorem 
provides: 

h(x,y) = f(x,y)<8>g(x,y)<* F*(u,v).G{u,v) = H(u,v) (32) 
Thus, correlation can be implemented by Fourier transforming the image /and the 
pattern g to obtain Fourier transformed functions F and G, complex conjugating one of 
20 the Fourier transformed functions, say F 9 and then multiplying these two functions F* and 
G, before transforming back. 
It is also noted that: 
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= \p(x, y) ® g mk (x 9 y)]+ [g mk (x, y) ® S mJfc (x, ^)] 

Hence, the effectiveness of the embedding and detection of pattern g m k in typical 
images depends on the cross-correlation of the original image p with the chosen pattern 
g mk being of low magnitude and widely dispersed. This is difficult to estimate however, 
5 generally, the cross-correlation part is very small compared to the auto-correlation part. 
The heuristic argument for this is that LRHFs do not resemble features in typical images 
p. The LRHFs proposed have both wide spatial support and wide spectral support. 

Consider the correlation between two LRHFs g mk (r) and g nl (r), being the 
second term in Equation (33). The Fourier transforms of the LRHFs g mk (r) and g nl (r) 
10 are of the form: 

Zjr)= r'r'-f « H+q-^q-**** (34) 

g nl {r)= r'r'-'e™ W^q*-** (35) 

The product of the complex conjugate of the transform of LRHF g mk (r) and the 
transform of g nl (r) , provides: 

15 H mhtl («, v) = ^-^q^e^q-^q^ = 1^1^^^^ (36) 

The phases partly cancel when the two chosen LRHFs g mk (r) and g nl (r) are 
similar. Only when the functions are identical do the phases entirely cancel out. Phase 
cancellation is the classic condition for maximum correlation, although a purely linear 
phase component can exist and only indicates a shift in the two original functions. 
20 In the case where the two LRHFs g mk (r) and g nl (r) are identical, Equation (36) 

reduces to: 
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H mkmk (u,v) = (M mtp f q 



-2p-4 



(37) 



In such a case the correlation peak will be of the form 



Kkmk (x,y)~S(x,y) 9 p = -l^ 



(38) 



The above equations are ideals, and the correlation peaks will be finite and 



5 discrete approximations to the ideal in practice. 

However, the pattern gnfay) is typically limited to real values only when 
embedding in the discrete image ftx,y)=p(x,y)+g n i(x,y). The discrete image j{x,y) is 
typically further limited by only 8 bits of data per pixel, thus greyscale levels 0-255. As 
noted earlier, all the preceding analysis extends easily to the case where a real pattern 
10 W(g mk ) is embedded in an image p(x,y) and detected with a complex pattern g ni . The main 
difference is a 2 times increase in the noise compared to the full complex correlation, or: 



Another difference is that the correlation of a pattern g nl with the real part of that 
pattern g ni is no longer a real power of r. Some oscillating structure will "leak" through, 
15 both radial and tangential. 

The underlying mathematical method of LHRF correlation is invariant to any scale 
variation. As noted before, the maximum frequency q max is kept below the Nyquist 
frequency of the discrete image. The maximum frequency q max is as defined in Equation 
(27), and determines the size of the 'hole' in the centre of the pattern. Similarly the size 
20 of the image introduces a maximum pattern size. In the simplest case, the pattern is 



Hg mk )®g nl \ 



\grnk ®Snt 
2 



(39) 
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restricted to an annular region defined by radii Rj and R2. However, square or other 
shapes may also be used to restrict the patterns. 

In addition to the conventional correlation process outlined above, and in 
particular Equations (36), (37) and (38), enhanced forms of correlation may also be 
usefully employed for the detection of embedded patterns. 

One form of enhanced correlation is to boost the high frequency components of 
the conventional correlation. This has the effect of changing the real exponent p in 
Equations (37) and (38) resulting in a correlation peak which resembles the delta function 
in the second part of Equation (38). 

Another form of enhanced correlation is known as "phase-only" correlation. Phase 
only correlation is implemented by taking the Fourier correlation magnitude, expressed in 
Equation (37) for example, and setting it to unity. This ensures that only the phase terms 
contribute to the overall correlation peak. Again, the peak shape tends to resemble a delta 
function. 

A variety of enhanced correlation processes, which consist of intermediates 
between frequency-boosted correlation and phase-only correlation, are also possible and 
applicable to the correlation detection. 

Roughly speaking, the ratio of the two radii Rj and R2 in the annulus determine the 
extremes of the possible scale variations before correlations fail completely. Hence, the 
minimum scaling factor is RjR 2 and the maximum is R 2 /R x > Preferably, the limits are 
set at 50% overlap area between an embedded pattern gkm and a detection pattern g in> in 
which case the two scaling ratios are: 




where X = — - 
R 2 



(40) 
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The range factor in this case is 

xJ^j < 41 > 

In a typical case, for example, where X = 4 , then the ratios are 0.72 and 2.12. 
The range of scale variation may be extended by performing the correlation upon a 
5 number of differently scaled versions of the watermarked image. This allows the overlap 
area to be improved in at least one of the correlations. So, for example a sequence of 
images rescaled by progressive factors of 2 would guarantee one of the images to fit the 
50% overlap criterion (for X > 4), and hence give a strong correlation peak. 

The foregoing described the properties of LRHFs. Fig. 4 shows a schematic 
10 diagram of a process 450 of watermarking an image 400 or document with a pattern 410, 
such as the real part of a LRHF g mk shown in Fig. 3 A. The pattern 410, which may be 
called a watermark, is simply added to the image 400 to form a watermarked image 420. 
If the image 400 is in colour, then the pattern 410 is added to the luminance part of a 
colour image 400. This allows the watermark to survive when the watermarked image is 
15 converted from colour to a greyscale representation. 

Preferably, the pattern 410 component in the watermarked image 420 is invisible 
or imperceptible to the human visual system under normal viewing conditions. This is 
done by multiplying the pattern 410 with a constant embedded factor 430, thereby adding 
a low intensity copy of the pattern 410 to the image 400. 
20 A collection of patterns may also be added to the image 400. Fig. 5 shows the 

sum of 6 shifted LRHFs, similar in form as those shown in Fig. 3 A. Before patterns are 
added to images for watermarking, a scale is applied to their intensity, or the intensity of 
their sum in the case of a collection of patterns, so that their intensity is approximately of 
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the range -5 to +5 (for example) to avoid wide intensity variation. It is noted that the 
intensities of the image shown in Fig. 5 has been amplified to the range 0-255 to more 
clearly show the patterns. 

Fig. 6 shows the watermarked image formed by adding the watermark represented 
5 in Fig. 5 to a test image, in this case Lena. The watermark is perceptible in regions having 
low intensity variation, such as region 501. 

In a preferred implementation, an adaptive scheme is used to reduce the level of 
the watermark in regions having low intensity variation and increase the level of the 
watermark in regions of high intensity variance. The watermark is a real function with the 
10 following general form: 



The window function w n (r,0) is a slowly varying function relatively to the 
pattern function r i€Cm e ike . Firstly, the window function w n (r,&) is used to remove or de- 



15 Furthermore, the window function w n (r,0) is also used to reduce the pattern intensity in 
regions of an image to which it is applied, where the pattern would otherwise be highly 
visible, such as "flat" sky regions. The de-emphasis window function w n (r 9 0) may be 
calculated by estimating the perceptual masking in various regions of the image. An 
example measure of perceptual masking is local gradient magnitude of the luminance in 

20 the image. Others include second partial derivatives of the luminance; local estimates of 
the "energy" or frequency content, local variance, and more sophisticated estimates of 
human visual system masking. 




(42) 



emphasise the high frequency central region of the pattern function l^r^e 1 
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Fig. 7A shows a schematic diagram of an alternative process 750 of watermarking 
an image 700. A perceptual mask 720 is formed from the image 700. The pattern 710 
with parameters k and m (or a combination of patterns) is then de-emphasised with the 
perceptual mask 720 by multiplying the pixel values of the perceptual mask 720 with 
5 corresponding pixel values of the pattern 710. The resulting pattern is of the form of 
Equation (44). This de-emphasised pattern is added to the image 700 to for a 
watermarked image 730. 

Preferably, the pattern 710 component in the watermarked image 730 is invisible 
or imperceptible to the human visual system under normal viewing conditions. This is 
10 done by multiplying the pattern 710 with a constant embedded factor 740, thereby adding 
a low intensity copy of the pattern 710 to the image 700. 

Fig. 7B shows the watermarked image formed by adding the watermark 
represented in Fig. 5 to the test image, using the process 750 shown in Fig. 7 A. The 
watermark that was perceptible in region 501 of Fig. 6 is no longer perceptible in a 
15 corresponding region 502. 

The window function w n (r,0) can also contain other information, for example a 
constant phase (ie complex) factor. Such a phase factor causes a constant phase offset to 
the pattern function i^r^e™ . Li one implementation, this phase factor is made random, 
making every watermark unique, even when the same parameters a m and k are used. Such 
20 a watermark would be even harder to detect. 

Again, with colour images, the de-emphasised pattern g ktm ,„(x,y) may be added to 

the luminance part of the signal. Alternatively, the de-emphasised pattern g k , mffl (x,y) 
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may be added to the R, G, B, H, V, S, u, v etc channels of the colour image, or any 
combination thereof. 

The watermark that is embedded into an image generally consists of a summation 
of separate basis patterns g with varying location , windows, and tuning parameters: 

5 w *(x- x *>y-yn likMMnu (x-x H , y -y n ) ( 43 ) 

where window function w' n removes or de-emphasises the high frequency central region 
of each of the separate basis patterns g . 

The window function w(x,y) for applying perceptual de-emphasis may be applied 
after the summation process, to form a watermark as follows: 

10 W(X 9 y)^ ml K( X - X n>y-yn }gk(n)Mn),n ( X ~ X n > -V ~ ) ( 44 ) 

The watermark encodes information in the centre location (x n ,y n ) strength, relative 
phase, and parameters k(n) and a m(n ) of each of the N basis patterns g . In practice the 
centre location (x n ,y n ) strength is not a robust carrier of information, as it can be easily 
attenuated, even accidentally, by any processing of the watermarked image. 

15 Fig. 8 shows a schematic diagram of a process 800 of detecting a watermark in a 

watermarked image 810. The watermarked image 810 is simply correlated with a 
complex pattern 820 having parameters k and a m , such as that shown in Figs. 3A and 3B, 
to form a result image 830. Referring to Equation (33), if the complex pattern 820 is 
present in the watermarked image 810, in particular the real part of a LRHF having 

20 parameters k and a m , then the result image 830 will have correlation magnitude peak(s) at 
centre location(s) where that pattern 820 was embedded into the image. The use of 
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different parameters, say / and a„, in the pattern 820 will result in no correlation 
magnitude peaks in the result image 830. 

With more than one basis pattern g used in the watermark, the process 800 of 
detection may be repeated for each of the basis patterns g . 
5 The process 800 may also be used with watermarked images 810 where process 

750 shown in Fig. 7 A was used to embed the watermark 710 into the image 700, using de- 
emphasis of the watermark. 

Fig. 9 shows a schematic diagram of an alternative process 900 of detecting a 
watermark in a watermarked image 910. A perceptual mask 920 is formed from the 

10 watermarked image 910. The watermarked image 910 is then emphasised with the 
perceptual mask 920 by dividing the pixel values of the watermarked image 910 by pixel 
values of corresponding pixel values of the perceptual mask 920. This emphasised image 
930 is correlated with the complex pattern 940 to for a result image 950. 

Fig. 10A shows the magnitude image of the correlation of the correct LRHF 

15 g m k( r ) ^ e watermarked image of Fig. 6 using process 800. Fig. 10B shows the 
detail of the peak structure of one of the magnitude peaks of Fig. 10A. Fig. 11A shows 
the magnitude image of the correlation of the correct LRHF g mk (r) with the watermarked 
image of Fig. 7B using process 900, whereas Fig. 11B shows the detail of the peak 
structure of one of the magnitude peaks of Fig. 11 A. Note that the magnitude peaks 

20 shown in Figs. 10B and 1 IB are very sharp and clear, whereas the background correlation 
is small. An improvement in the sharpness of the magnitude peaks is also visible in Fig. 
11B. Thus, whereas the watermark process 750 using de-emphasis makes the pattern less 
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perceptible, the watermark detection process 900 using emphasis improves detection by 
resulting in sharper magnitude peaks. 

The magnitude peaks can only be detected by correlation with the known LRHF(s) 
used for embedding, or by an exhaustive search of correlation magnitude peaks by using 
5 the full range of parameters k and a m . The exhaustive search can be expected to be many 
orders of magnitude slower than detection using the correct parameters k and ct m , making 
the method difficult to attack. 

Fig. 12 shows the watermarked image of Fig. 7B rotated by 20 degrees and 
increased in size by 20%. The image has also been cropped and a gamma correction 
10 power of 0.8 has been applied. These operations were performed on the 8-bit image data 
using linear interpolation. 

Performing the watermark detection process 900 shown in Fig. 9, using the correct 
detection LRHF g mk (r), the result shown in Fig. 13 is obtained. Fig. 14 shows the detail 

of the peak structure of one of the magnitude peaks of Fig. 13. There is some degradation 
15 of the peak structure compared to the magnitude peaks of Fig. 11B, but the correlation 

magnitude peaks are still well above the background noise level. 

For an image containing a single magnitude peak, detection is relatively 

straightforward, in that the pixel containing the maximum modulus value is selected , and 

its coordinates define the centre of the embedded pattern. 
20 For images containing multiple peaks to be detected, a slightly more complex 

approach is used. If a detection image contains s peaks, those s peaks may be detected as 

follows: 
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- Find the pixel with maximum modulus among pixels in consideration. This 
pixel pi is one of the s pixels; 

- Exclude all pixels in a disk of some radius q around pixel p, from 
consideration; and 

5 - Repeat s times in total. 

The radius q is chosen depending upon the application. When alignment peaks 
are very well spaced, a large value for q, say 20 pixels, may be used. Peaks used to 
encode information may be much closer together, and a smaller value for q should be 
used. 

10 The proposed processes of watermarking and detection of watermarks are 

inherently robust to most image distortions. These include: 
Scale change from about 50% to +200%; 
Any rotation; 

JPEG compression down to about a 10:1 compression; 
15 Gamma correction; and 

Low pass filtering. 

In addition to the above, the method is more difficult to defeat than known 
methods where the watermarks can be detected by analysing the Fourier magnitudes of an 
image. Detection of LRHF g mk {r) based watermarks requires many correlations, 
20 typically more than 1000, if the parameters a m and k of the LRHF g mk (r) are unknown. 

There are many applications in machine and computer vision that require 
registration and alignment of objects. Accordingly, in a further implementation, LRHFs 
can be used purely to embed reference marks in images to allow reliable registration and 
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alignment of an image of, or applied to the object. The LRHFs may be embedded visibly 
or invisibly. Additional patterns may be added to carry a watermark message. 

The detection of the pattern is performed by using method 800 or 900, shown in 
Figs. 8 and 9 respectively. Once the registration marks in the form of magnitude peaks in 
the resulting magnitude image are detected then the rotation and scaling parameters can be 
estimated and the watermarked image set back to its nominal scale and rotation setting. 

An example registration method is outlined as follows: 

For encoding, peaks are encoded at three comers of a square of known size. 

For decoding, these peaks are detected in a possibly transformed image. The 
rotation angle may be estimated using the vector between the two peaks which are furthest 
apart. Similarly, the total scaling factor may be estimated using the distance between 
these two peaks. The shear factor may be estimated by measuring how far the angle 
between the three points differs from the perpendicular. The change in aspect ratio may 
be estimated by measuring the difference in the length of the horizontal side and the 
vertical side. 

The four parameters (angle, scaling, shear and aspect ratio) completely define a 
linear transformation. This transformation may be inverted to restore the image to its 
original size and orientation. 

Scaling and rotation may be performed by a variety of resampling algorithms. 
Typically a high quality resampling using bi-cubic interpolation, Fourier interpolation, or 
even a non-linear resampling scheme may be used. Once the watermarked image is back 
at its nominal settings, an alternative watermarking or steganographic method may be 
utilised to extract further information from the image. 
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In another implementation, the registration patterns are used in conjuction with 
any other watermarking technique. The registration is performed before reading the 
embedded watermark. 

Registration may include focusing because the correlation magnitude peaks 
5 provide a nice smooth variation in magnitude with respect to changes in the focus of 
imaging systems. Focus can be estimated by correlation peak width. An advantage of a 
width based measure of focus is that it is normalised and does not depend upon the 
absolute peak level. 

Registration may further include aspect ratio correction and shearing to some 
10 extent, due to the strength of the correlation magnitude peaks. 

The above patterns used as the watermark were all radial-tangential functions 
having the form of Equation (40). However, patterns that only vary in one dimension may 
also be used, such as patterns of the following form: 

15 This pattern only has variation in a x direction. Any direction could be chosen in 

practice. Process 450 or 750, shown in Fig. 4 and 7 respectively, may be used to embed 
the pattern into an image. 

The one dimensional pattern may be detected using process 800 or 900, shown in 
Figs. 8 and 9 respectively, to detect the centre line position of a pattern, if the correct 

20 parameter a m is known. In particular, a two-dimensional complex pattern having the form 
of Equation (13) is used as the pattern 820 in process 800, with the two-dimensional 
complex pattern having the same parameter a m , but zero spiral parameter k. The detection 
is unaffected by shear or anamorphic magnifications. 
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It is also possible to construct scale invariant patterns from a separable product of 
one dimensional patterns, thus having the form: 

s,Ax,y) = ^y)\xf ,+p '\yf" +P ' ^ 

However, such patterns are not rotation invariant. It is noted that the separable 
5 directions {x\y') do not need to be orthogonal. A sequence of the above patterns may be 
summed to form the overall watermark. Radial harmonic patterns of the form of Equation 
(40) may also be added. In one implementation, the radial harmonic pattern(s) is added 
for registration, allowing the watermarked image to be rotated back to its original 
orientation, before the pattern is detected by using one of the detection processes 800 or 
10 900. 

As stated above, the watermark encodes information in the centre location (x n ,y n ) 
strength, phase, and parameters k(n) and a m(n ) of each of the N basis patterns g . For 
example, the location (x n j/ n ) of each peak could store several bits of data. More 
sophisticated methods may also be used such as described below. Detection of the stored 

15 data requires that the peak and its position be identified reliably. This process may entail 
some error correcting or data redundancy scheme. 

Using the peak localisation property, several independent watermarking basis 
patterns g , with each basis pattern g centred on a pixel in a 64x64 square grid in the 
image which is used for watermarking. To allow accurate extraction, each grid position is 

20 preferably separated by 7 pixels, thus the template grid pattern covers a region of 448x448 
pixels in the candidate image, which is small enough to embed in all but the smallest 
images. 
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Because the detection error is usually small and typically within 1-2 pixels, a 
scaling factor of 50% would result in a grid spacing of 3.5 pixels, which is still reliably 
detectable. Any scaling to smaller dimensions could result in errors during message 
decoding. Scaling to increased image size could tend to enhance the reliability of 
5 detection. 

This technique uses three points on a regular grid to provide information on the 
pattern orientation and scaling, a point to encode image length, and subsequent points to 
encode bits of information. 

Once the embedding grid has been established, each row and column position of 
10 the marks in the original grid may be derived from the detected position of each basis 
embedded in the watermarked image. 

The first three points define the comers of the embedding grid. A different basis 
pattern g defines each point, thus they may be detected in order and their relative 
positions used to establish the orientation and scaling of the grid in the watermarked 
15 image, and sufficiently small shear or anamorphic scaling changes. 

From the three comers of the grid, a linear transformation may be derived from the 
coordinates of the watermarked image to that of the original 64 point by 64 point grid. 

The fourth point in the sequence of detected bases is used to encode the length of 
the encoded message in bits. By assigning numbers from 0 to 4095 to each grid position, 
20 the fourth point may indicate a message of any length from 0 to 4095 bits. 

Subsequent points encode the bits of the message by concatenating the bits 
representing the row and column address of each point. In a 64 point by 64 point grid, 
each row or column address codes exactly 64 (2 6 ) separate values. Hence, each point on 
the 64x64 grid encodes up to 12 bits. 
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Modifications to this simple technique provide encoding schemes with slightly 
different properties. 

By embedding patterns on a 64 point by 64 point grid with only a single basis 
pattern g and B points, messages of L^f 4096 ^*-^}] bits usin S three alignment points 
5 may be stored, where C is the binomial coefficient and LJ is the floor operator. There are 
two advantages of this technique. Firstly, only a single correlation need be performed 
during detection, thus providing a faster detection method. Secondly, any image 
transformation will affect the relative phase of all detected points similarly. This provides 
an opportunity to encode at least one extra bit of information per basis, by comparing the 
1 0 complex phase of each detected peak with that of the first. 

Encryption may be performed on the bitstream to hide information from persons 
not holding the appropriate keys. 

Checksums may be added to the bitstream to provide verification of the detected 
watermark, and also as an aid in locating information-containing watermark patterns. 
15 Error-correcting codes may be added to the bitstream to increase the robustness of 

the encoded bitstream, albeit with the requirement of embedding more basis patterns g in 
the original watermark, perhaps making the mark more visible. 

To make the embedded pattern harder to discover with malicious intent, multiple 
basis patterns g may be added together at the same position and the sum of their 
20 detection magnitude peaks used during detection. In this case, each detection peak alone 
may be too small to measure, but the summation of the amplitude of all detection images 
will combine to produce a very well-defined peak. Only by knowing a large fraction of 
the multiple bases can the detection peak, and hence the basis for watermarking, be found. 



514005.doc 



-29- 



The process of embedding and detecting rotation and scale invariant bases has 
several properties, which provide the means to embed a substantial amount of information 
in an image watermark and recover it with great reliability. These properties include: 

The amplitude peaks recovered from a watermarked image are extremely sharp 
5 and well localized, typically within 1-2 pixels. Thus their embedded position in the 
original image can be recovered with a great degree of accuracy. 

Each watermarking basis pattern g is orthogonal to all other bases having 
different parameters k and a m . Thus, if many different bases patterns g are used in the 
watermark, a peak for each basis may be recovered almost independently of all other 
10 bases patterns g . 

If a single basis pattern g is used to embed a watermark, the magnitude peaks in 
the detected image will all be of identical complex phase. If multiple basis patterns g are 
used which differ only in complex phase, i.e. each basis pattern g is multiplied by a 
different complex constant of unit modulus, then the relative phase of all detected 
15 magnitude peaks will be preserved. In the best case, a single detected point may be used 
to determine the base phase, and the phase of subsequent magnitude peaks in the result 
image will retain their relative relationship to this base point. 

The sharpness and amplitude of detection magnitude peaks is not substantially 
affected by any rotation or scaling transformations applied to the image, although the 
20 position of the magnitude peaks themselves will be rotated and scaled with the 
watermarked image. Thus, any rotation or scaling can be detected and corrected for by 
using the position of alignment points. 
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To a certain extent, shearing or anamorphic (aspect ratio) changes may also be 
detected and taken into account, thus the method is applicable to arbitrary linear 
transformations as long as the shear, scaling or anamorphic component is small enough. 

By using iterative searching, any linear transformation to the coordinate system of 
5 a watermarked image that did not ruin its content could be detected and corrected for. 

In addition to the aforementioned uses for embedded patterns, there are numerous 
other applications, some of which will now mentioned. 

The use of a watermark allows a code to be embedded into an image. Such a code 
will remain with the image even if the header and other metadata of the image file are 
10 removed. This allows the code to remain strongly attached to the actual image itself. The 
code may be usefully employed to define the address or location of the original metadata 
related to the image. The metadata may contain owner identification, camera settings, 
geographical location, details of the subjects in the image, or any number of pieces of 
other information. Image metadata may be stored on the same device as the image, or on 
15 a server connected by a network, or even a server owned by a third party on the Internet. 

A watermark can also embed a copyright owner's information into an image. The 
copyright information will be difficult to detect or remove by anyone who does not have 
knowledge of the parameters used to define the embedded patterns. Without the 
embedded pattern parameters it is necessary to search a large number of possible 
20 configurations before correlation peaks may be detected. The difficulty in searching may 
be sufficient to dissuade attacks upon this copyright marking method. 

The processes 450, 750, 800 and 900 can be implemented on a system 200 shown 
in Fig. 15. In particular, one or more of the processes 450, 750, 800 and 900 may be 
implemented as software executing within the system 200, where the processes 450, 750, 
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800 and 900 are effected by instructions in the software that are carried out by the system 
200. The software may be stored in a computer readable medium, including the storage 
devices described below, for example. The software is loaded into the system 200 from 
the computer readable medium, and then executed by the system 200. A computer 
5 readable medium having such software or computer program recorded on it is a computer 
program product. The use of the computer program product in the system 200 preferably 
effects an advantageous apparatus for watermarking, watermark detection or registration. 

The pattern embedding and detecting processes 450, 750, 800 and 900 may be 
included as a plug- in module for commercially available software packages. In particular, 
10 packages which are used for the manipulation and editing of digital image files would 
benefit by the addition of the pattern embedding and detection software. 

The embedding and/or the detection of the watermarks may be operated as a 
service by a third party. The images may be conveyed by a digital network for embedding 
and then returned to the owner with the hidden mark. Similarly an image thought to 
15 contain a mark may be submitted to the third party operator for detection of marks with 
specified parameters. 

Libraries of digital images could incorporate embedded pattens to maintain 
connections with image metadata and also to maintain image copyright information. 

Digital cameras, whether still or video would benefit from the inclusion of pattern 
20 embedding software and/or software to allow embedding of information immediately 
following image acquisition. The advantage in such a system is that unmarked images 
would be difficult or impossible to obtain. 

The system 200 may, for example, be a general-purpose computer, a digital 
camera, a video camera, a scanner or a photocopier. The system 200 comprises a 
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computer module 201, output device(s) 215 and input devices such as controls 202 and 
digital capture device 203. The digital capture device 203 may be an image sensor, such a 
two-dimensional CCD array. The computer module 201 typically includes at least one 
processor unit 205, a memory unit 206, for example formed from semiconductor random 
5 access memory (RAM) and read only memory (ROM), input/output (I/O) interface(s) and 
a storage device 209. The components 205 to 213 of the computer module 201, typically 
communicate via an interconnected bus 204 and in a manner which results in a 
conventional mode of operation of the computer system 200 known to those in the 
relevant art 

10 In the case where the system 200 is a general-purpose computer, the output device 

215 includes a display device. A printer may also be provided. The controls 202 include 
a keyboard and a mouse. The storage device 209 typically includes a hard disk drive, a 
floppy disk drive and a CD-ROM drive. Typically, the application program is resident on 
the storage device 209, and read and controlled in its execution by the processor 205. 

15 Intermediate storage of the program may be accomplished using the semiconductor 
memory 206, possibly in concert with the storage device 209. In some instances, the 
application program may be supplied to the user encoded on a CD-ROM or floppy disk 
and read via a CD-ROM drive or floppy disk drive 211, or alternatively may be read by 
the user from a network (not illustrated). Still further, the software can also be loaded 

20 into the computer system 200 from other computer readable medium including magnetic 
tape, a ROM or integrated circuit, a magneto-optical disk, a radio or infra-red 
transmission channel between the computer module 201 and another device, a computer 
readable card such as a PCMCIA card, and the Internet and Intranets including e-mail 
transmissions and information recorded on websites and the like. The foregoing is merely 
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exemplary of relevant computer readable mediums. Other computer readable mediums 
may be practiced without departing from the scope and spirit of the invention.In the case 
where the system 200 is a digital camera or video camera, the image(s) and/or the 
watermarked image(s) may be stored onto the storage device 209 or communicated to 
5 another device (not illustrated). 

One or more of the processes 450, 750, 800 and 900 may alternatively be 
implemented in dedicated hardware such as one or more integrated circuits performing the 
functions or sub functions of those processes 450, 750, 800 and 900. Such dedicated 
hardware may include graphic processors, digital signal processors, or one or more 

10 microprocessors and associated memories. 

Thus, images may be obtained by the system 200 using the digital capture 
device(s) 202 or through the storage device 209. Watermarked images may be displayed, 
printed , stored or communicated to other devices. Similarly, watermarked images may be 
obtained by the system 200 using the digital capture device(s) 202 or through the storage 

15 device 209. 

In another implementation, the digital capture device 203 is an audio device, and 
the system 200 is used to embed watermarks of the form: 

*„(0=IC + ' < 47 > 

into audio streams, where t is a time in the audio stream. 
20 Audio signals whether digital or (high quality) analogue may have very low level 

patterns or signals added with very little differences being perceptible. If the signal length 
is long enough, then a strong correlation peak is obtainable provided the pattern 
parameters are known. In this way information (copyright or otherwise) may be 
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embedded in the audio signal. The embedding device, which may be software or 
hardware, may be located near the input of an audio capture device, such as a microphone. 
Alternatively the embedding process may take place near the output device of an audio 
production system. In this case the embedded patterns would be optimised for the final 
output medium, such as Compact Disc or Digital Audio Tape. The patterns would 
survive and still be detectable after sophisticated watermark attacks such as pitch 
changing and resampling because of the scale invariant property. 

In yet another implementation, the correlation is performed optically through the 
use of spatial light modulators. 

The foregoing describes only some implementations, and modifications and/or 
changes can be made thereto without departing from the scope and spirit of the invention, 
the implementation(s) being illustrative and not restrictive. 

In the context of this specification, the word "comprising" means "including 
principally but not necessarily solely" or "having" or "including" and not "consisting only 
of. Variations of the word comprising, such as "comprise" and "comprises" have 
corresponding meanings. 
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ni« i i % » g The Claims defining the invention are as follows 

1 . A method of watermarking an image, said method comprising the step of: 
mathematically adding at least one basis pattern to said image, wherein said basis 

5 pattem(s) is scale and rotation invariant within a complex multiplicative constant. 

2. A method as claimed in claim 1, wherein said basis pattem(s) is of the form: 

with k, p and a m being parameters of said basic pattern(s), r being a polar distance defined 
10 in terms of the Cartesian axes of said image as r 2 =x 2 +y 2 and 6 = tan 

3. A method as claimed in claim 2 comprising the further initial step of removing 
region(s) of said basis pattem(s) having frequencies above a predetermined frequency. 

15 4. A method as claimed in claim 2 or 3, wherein at least a first and a second basis 
patterns are added to said image, with at least one parameter k or a m of said first basis 
pattern being different to that of said second basis pattern. 

5. A method as claimed in any one of claims 2 to 4, wherein a plurality of basis 
20 patterns are added with different offset relative to a center of said image. 
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6. A method as claimed in any one of claims 2 to 5, comprising the further initial 
step of encoding information into at least one of said parameters, said offset, an amplitude 
or a relative phase added to said basis pattern. 

7. A method as claimed in any one of claims 2 to 6, wherein parameter k=0 and said 
polar distance r is a function of Cartesian co-ordinate x or y only. 

8. A method as claimed in any one of claims 1 to 7, comprising the further step of 
de-emphasising regions of said basis pattern(s) corresponding with regions of said image 
having low intensity variation. 

9. A method of detecting a pattern in a watermark of an image, said watermark 
comprising at least one basis pattern, with said pattern and said basis pattern(s) being 
scale and rotation invariant within a complex multiplicative constant, said method 
comprising the steps of: 

correlating said image with said pattern; and 

locating one or more magnitude peaks, said peak(s) corresponding to center 
position(s) of basis pattem(s) having the same parameters as that of said pattern. 

10. A method as claimed in claim 9, said pattern and said basis pattem(s) being of the 
form: 
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with K P and a m being parameters of said pattern and basic pattern(s), r being a polar 
distance defined in terms of the Cartesian axes of said image as r 2 =x 2 +y 2 and 

5 11. A method as claimed in claim 10 comprising the further initial step of removing 
regions of said pattern having frequencies above a predetermined frequency. 

12. A method as claimed in claim 10 or 11, comprising the further final step of 
decoding information from at least one of said parameters, said peak position(s), an 

10 amplitude or relative phase of said peak(s). 

13. A method as claimed in any one of claims 9 to 12, comprising the further step of 
de-emphasising regions of said pattern corresponding with regions of said image having 
low intensity variation. 

15 

14. A method of adding registration marks to an image, said method comprising the 
step of: 

mathematically adding a plurality of basis patterns to said image, wherein at least 
two of said basis patterns are added with different offsets relative to a center of said 
20 image, and said basis patterns are scale and rotation invariant within a complex 
multiplicative constant. 

i 

15. A method as claimed in claim 14 wherein said basis patterns are of the form: 
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g m *(r,0) = r 



_ ^ia^+p ik0 



with k, p and a m being parameters of said basic patterns, r being a polar distance defined 



in terms of the Cartesian axes of said image as r 2 =x 2 +y 2 and 0 - tan' 



5 16. A method as claimed in claim 15, wherein at least one parameter k or a m of a first 
basis pattern is different to that of a second basis pattern. 



17. A method as claimed in any one of claims 14 to 16, comprising the further step of 
de-emphasising regions of said basis patterns corresponding with regions of said image 

10 having low intensity variation. 

18. A method of registering an image having a watermark embedded, said watermark 
comprising a plurality of basis patterns, said method comprising the steps of: 

correlating said image with a pattern; said pattern and said basis patterns being 
15 scale and rotation invariant within a complex multiplicative constant; 

locating peak positions, said peak positions corresponding to center positions of 
basis patterns having the same parameters as that of said pattern; 

comparing said peak positions with predetermined positions from an original 
image; and 

20 transforming said image to invert linear transformations. 



19. A method as claimed in claim 18 wherein said pattern and said basis patterns are 
of the form: 
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g mk (r,0) = r ia - +p e**, 

with k and a m being parameters of said pattern and basic patterns, r being a polar distance 
defined in terms of the Cartesian axes of said image as r 2 =x 2 +y 2 and 6 = tan" 1 j^^/J . 

5 20. A method as claimed in claim 19 comprising the further initial step of removing 
regions of said pattern having frequencies above a predetermined frequency. 

21. A method as claimed in any one of claims 18 to 20, comprising the further step of 
de-emphasising regions of said pattern corresponding with regions of said image having 

1 0 low intensity variation. 

22. A method of watermarking an audio stream, said method comprising the step of: 
mathematically adding at least one basis signal to said audio stream, wherein said 

basis signal(s) is scale invariant within a complex multiplicative constant. 



15 



20 



23. A method as claimed in claim 22, wherein said basis signal(s) is of the form: 

*.<o=lC + ', 

with a m and p being parameters of said basic signal(s) and / being a time in said audio 
stream. 

24. A method as claimed in claim 23 comprising the further initial step of removing 
region(s) of said basis signal(s) having frequencies above a predetermined frequency. 
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25. A method as claimed in any one of claims 22 to 24, comprising the further step of 
de-emphasising regions of said basis signal(s) corresponding with regions of said audio 
stream having low amplitude variation. 

5 26. A method of detecting a signal in a watermark of an audio stream, said watermark 
comprising at least one basis signal, with said signal and said basis signal(s) being scale 
invariant within a complex multiplicative constant, said method comprising the steps of: 
correlating said audio stream with said signal; and 

locating one or more magnitude peaks, said peak(s) corresponding to center 
10 position(s) of basis signal(s) having the same parameter as that of said signal. 

27. A method as claimed in claim 26 wherein said signal and said basis signal(s) are 
of the form: 

15 with a m and p being parameters of said signal and basic signal(s) and t being a time in 
said audio stream 

28. A method as claimed in claim 27 comprising the further initial step of removing 
regions of said signal having frequencies above a predetermined frequency. 

20 

29. A method as claimed in any one of claims 26 to 28, comprising the further step of 
de-emphasising regions of said signal corresponding with regions of said audio stream 
having low intensity variation. 
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30. Apparatus for watermarking an image, said apparatus comprising: 

means for mathematically adding at least one basis pattern to said image, wherein 
said basis pattern(s) is scale and rotation invariant within a complex multiplicative 
5 constant. 

31. Apparatus as claimed in claim 30, wherein said basis pattern(s) is of the form: 

r,0) = r p e , 

with k, p and a m being parameters of said basic pattern(s), r being a polar distance defined 
10 in terms of the Cartesian axes of said image as r 2 =x 2 +y 2 and 6 = tan 

32. Apparatus as claimed in claim 31, further comprising means for removing 
region(s) of said basis pattem(s) having frequencies above a predetermined frequency. 

15 33. Apparatus as claimed in claim 31 or 32, wherein at least a first and a second basis 
patterns are added to said image, with at least one parameter k or a m of said first basis 
pattern being different to that of said second basis pattern. 

34. Apparatus as claimed in any one of claims 31 to 33, further comprising means for 
20 encoding information into at least one of said parameters, said offset, an amplitude or a 
relative phase added to said basis pattern. 
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35. Apparatus as claimed in any one of claims 31 to 34, wherein parameter h=0 and 
said polar distance r is a function of Cartesian co-ordinate x ory only. 

36. Apparatus as claimed in any one of claims 30 to 35, wherein a plurality of basis 
5 patterns are added with different offset relative to a center of said image. 

37. Apparatus as claimed in claim 30 or 36, further comprising means for de- 
emphasising regions of said basis pattem(s) corresponding with regions of said image 
having low intensity variation. 

10 

38. Apparatus for detecting a pattern in a watermark of an image, said watermark 
comprising at least one basis pattern, with said pattern and said basis pattern(s) being 
scale and rotation invariant within a complex multiplicative constant, said apparatus 
comprising: 

15 means for correlating said image with said pattern; and 

means for locating one or more magnitude peaks, said peak(s) corresponding to 
center position(s) of basis pattern(s) having the same parameters as that of said pattern. 

39. Apparatus as claimed in claim 31, with said pattern and said basis pattern(s) being 
20 of the form: 

ia m + p Ak& 

r,9) = r - p e , 
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with k, p and a m being parameters of said pattern and basic pattern(s), r being a polar 

2 2 2 

distance defined in terms of the Cartesian axes of said image as r =x +y and 

40. Apparatus as claimed in claim 39, further comprising means for removing regions 
of said pattern having frequencies above a predetermined frequency. 

41. Apparatus as claimed in claim 39 to 40, further comprising means for decoding 
information from at least one of said parameters, said peak position(s), an amplitude or 
relative phase of said peak(s). 

42. Apparatus as claimed in any one of claims 38 or 41, further comprising means for 
de-emphasising regions of said pattern corresponding with regions of said image having 
low intensity variation. 

43. Apparatus of adding registration marks to an image, said apparatus comprising: 
means for mathematically adding a plurality of basis patterns to said image, 

wherein said basis patterns are scale and rotation invariant within a complex 
multiplicative constant, and at least two of basis patterns are added with different offset 
relative to a center of said image. 

44. Apparatus as claimed in claim 43, wherein said basis patterns are of the form: 
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with k and a m being parameters of said basic patterns, r being a polar distance defined in 
terms of the Cartesian axes of said image as r 2 =x 2 +y 2 and 6 = tan 

45. Apparatus as claimed in claim 44, wherein at least one parameter k or a m of a first 
5 basis pattern is different to that of a second basis pattern. 

46. Apparatus as claimed in any one of claims 43 to 45, further comprising means for 
de-emphasising regions of said basis patterns corresponding with regions of said image 
having low intensity variation. 

10 

47. Apparatus of registering an image having a watermark embedded, said watermark 
comprising a plurality of basis patterns, said apparatus comprising: 

means for correlating said image with a pattern; said pattern and said basis 
patterns being scale and rotation invariant within a complex multiplicative constant; 
15 means for locating peak positions, said peak positions corresponding to center 

positions of basis patterns having the same parameters as that of said pattern; 

means for comparing said peak positions with predetermined positions from an 
original image; and 

means for transforming said image to invert linear transformations. 

20 

48. Apparatus as claimed in claim 47, said pattern and said basis patterns being of the 
form: 
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with k, p and a m being parameters of said pattern and basic patterns, r being a polar 



5 49. Apparatus as claimed in claim 48 further comprising means for removing regions 
of said pattern having frequencies above a predetermined frequency. 

50. Apparatus as claimed in any one of claims 47 to 49, further comprising means for 
de-emphasising regions of said pattern corresponding with regions of said image having 

10 low intensity variation. 

51. Apparatus as claimed in any one of claims 30 to 50, wherein said basis pattem(s) 
is distorted using amplitude soft thresholding. 

15 52. Apparatus of watermarking an audio stream, said apparatus comprising: 

means for mathematically adding at least one basis signal to said audio stream, 
wherein said basis signal(s) is scale invariant within a complex multiplicative constant. 

53. Apparatus as claimed in claim 52 wherein said basis signal(s) is of the form: 



with a m and p being parameters of said basic signal(s) and t being a time in said audio 
stream. 



distance defined in terms of the Cartesian axes of said image as f=x 2 +y 2 and 




20 



*.<0 = |4' 
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54. Apparatus as claimed in claim 53 further comprising means for removing 
region(s) of said basis signal(s) having frequencies above a predetermined frequency. 

55. Apparatus as claimed in any one of claims 52 to 54, further comprising means for 
de-emphasising regions of said basis signal(s) corresponding with regions of said audio 
stream having low amplitude variation. 

56. Apparatus of detecting a signal in a watermark of an audio stream, said watermark 
comprising at least one basis signal, with said signal and said basis signal(s) being scale 
invariant within a complex multiplicative constant, said apparatus comprising: 

means for correlating said audio stream with said signal; and 
means for locating one or more magnitude peaks, said peak(s) corresponding to 
center position(s) of basis signal(s) having the same parameter as that of said signal. 

57. Apparatus as claimed in claim 56, with said signal and said basis signal(s) being of 
the form: 

~ /A \A ia m+P 

with a m being a parameters of said signal and basic signal(s) and t being a time in said 
audio stream. 

58. Apparatus as claimed in claim 57 further comprising means for removing regions 
of said signal having frequencies above a predetermined frequency. 



514005.doc 



-47- 



59. Apparatus as claimed in any one of claims 56 to 58, further comprising means for 
emphasising regions of said signal corresponding with regions of said audio stream 
having low intensity variation. 

60. A method as claimed in any one of claims 1 to 21, wherein said basis pattem(s) is 
distorted using amplitude soft thresholding. 

61. A method substantially as described herein with reference to the accompanying 
drawings. 

62. Apparatus substantially as described herein with reference to the accompanying 
drawings. 

Dated this TWENTY-SEVENTH day of OCTOBER 2000 
CANON KABUSHIKI KAISHA 
Patent Attorneys for the Applicant 
Spruson&Ferguson 
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